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Abstract 

Positive semidefinite programs are an important subclass of semidefinite programs in which 
all matrices involved in the specification of the problem are positive semidefinite and all scalars 
involved are non-negative. We present a parallel algorithm, which given an instance of a posi- 
tive semidefinite program of size N and an approximation factor £ > 0, runs in (parallel) time 
poly(i) ■ polylog(N), using poly(N) processors, and outputs a value which is within multi- 
plicative factor of (1 + e) to the optimal. Our result generalizes analogous result of Luby and 
Nisan (TDJ for positive linear programs and our algorithm is inspired by the algorithm of flO). 
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1 Introduction 



Fast parallel algorithms for approximating optimum solutions to different subclasses of semidef- 
inite programs have been studied in several recent works (e.g. j2l[3l|9l[ZH6l|5l) leading to many 
interesting applications including the celebrated result QIP = PSPACE [5]. However for each 
of the algorithms used for example in (Zl|6j|5]I/ in order to produce a (1 + e) approximation of 
the optimal value for a given semidefinite program of size N, in the corresponding subclass 
that they considered, the (parallel) running time was polylog(N) ■ poly(K) ■ poly(|), where k 
was a 'width' parameter that depended on the input semidefinite program (and was defined 
differently for each of the algorithms). For the specific instances of the semidefinite programs 
arising out of the applications considered in JZl[6j|5]/ it was separately argued that the corre- 
sponding 'width parameter' k is at most polylog(N) and therefore the running time remained 
polylog(N) (for constant e). It was therefore desirable to remove the polynomial dependence 
on the 'width' parameter and obtain a truly polylog running time algorithm, for a reasonably 
large subclass of semidefinite programs. 

In this work we consider the class of positive semidefinite programs. A positive semidef- 
inite program can be expressed in the following standard form (we use symbols >, < to also 
represent Lowner order). 

Dual problem D 



Primal problem P 

minimize: Tr CX 
subject to: Vz £ [m] : Tr A,X > bj, 
X > 0. 



maximize: V] ^iVi 



subject to: Y\ yi ■ A\ < C, 

i=i 

Vz G [m] : y t > 0. 

Here C,A\,.. .,A m are n x n positive semidefinite matrices and b\,...,b m are non-negative 
reals (in a general semidefinite program C, A\, . . . , A„, are Hermitian and b\,..., b m are reals). 
Let us assume that the conditions for strong duality are satisfied and the optimum value for P, 
denoted opt(P), equals the optimum value for D, denoted opt(D). We present an algorithm, 
which given as input, {C,A\,. . .,A m ,b\,. . .,b m ), and an error parameter £ > 0, outputs a 
(1 + e) approximation to the optimum value of the program, and has running time polylog(«) ■ 
polylog(m) ■ poly(i). As can be noted, there is no polynomial dependence on any 'width' 
parameter on the running time of our algorithm. The classes of semidefinite programs used 
in El ID are a subclass of positive semidefinite programs and hence our algorithm can directly 
be applied to the programs in them without needing any other argument about the 'width' 
being polylog in the size of the program (to obtain an algorithm running in polylog time). 

Our algorithm is inspired by the algorithm used by Luby and Nisan [10] to solve posi- 
tive linear programs. Positive linear programs can be considered as a special case of positive 
semidefinite programs in which the matrices used in the description of the program are all 
pairwise commuting. Our algorithm (and the algorithm in [10|) is based on the 'multiplicative 
weights update' (MWU) method. This is a powerful technique for 'experts learning' and finds 
its origins in various fields including learning theory, game theory, and optimization. The algo- 
rithms used in (21[3l[9j[7l|6l|5] are based on its matrix variant the 'matrix multiplicative weights 
update' method. The algorithm of Luby and Nisan |T0j proceeds in phases, where in each 
phase the large eigenvalues of Y%Li y\^i G/| s represent the candidate dual variables at time t) 
are sought to be brought below a threshold determined for that phase. The primal variable 
at time step t is chosen to be the projection onto the large eigenvalues (above the threshold) 
eigenspace of YX=\ V\^i- Using the sum of the primal variables generated so far, the dual vari- 
ables are updated using the MWU method. A suitable scaling parameter At is chosen during 
this update, which is small enough so that the good properties needed in the analysis of MWU 
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are preserved and at the same time is large enough so that there is reasonable progress in 
bringing down the large eigenvalues. 

Due to the non-commutative nature of the matrices involved in our case, our algorithm 
primarily deviates from that of flO| in how the threshold is determined inside each phase. The 
problem that is faced is roughly as follows. Since A ; 's could be non-commuting, when yjs 
are scaled down, the sum of the large eigenvalues of Y4L1 yt^-i ma y n ot come down and this 
scaling may just move the large eigenvalues eigenspace. Therefore a suitable extra condition 
needs to be ensured while choosing the threshold. Due to this, our analysis also primarily devi- 
ates from 1 10 ] in bounding the number of time steps required in any phase and is significantly 
more involved. The analysis requires us to study the relationship between the large eigenval- 
ues eigenspaces before and after scaling (say W\ and W2). For this purpose we consider the 
decomposition of the underlying space into one and two-dimensional subspaces which are in- 
variant under the actions of both ITi and IT2 (projections onto Wj and W2 respectively) and this 
helps the analysis significantly. Such decomposition has been quite useful in earlier works as 
well for example in quantum walk fT4l|l3l lTl and quantum complexity theory 1TT1IT21I . 

We present the algorithm in the next section and its analysis, both optimality and the run- 
ning time, in the subsequent section. Due to space constraints we move some proofs to the 
Appendix. 

2 Algorithm 

Given the positive semidefinite program (P, D) as above, we first show in Appendix lAl that 
without loss of generality (P, D) can be in the following special form. 

Special form Primal problem P Special form Dual problem D 

m 

maximize: )Z Vi 

i=l 
m 

subject to: Y\ Vi ' A < 1/ 

i=\ 

Vi e [m] : yt > 0. 

Here A\, . . . , A m are n x n positive semidefinite matrices and 1 represents the identity matrix. 
Furthermore, for all i, norm of A u denoted is at most 1 and the minimum non-zero 

eigenvalue of A; is at least i where 7 — 

In order to compactly describe the algorithm, and also the subsequent analysis, we intro- 
duce some notation. Let Y = Diag(yi, . . . , y m ) (m x m diagonal matrix with Y(i, i) = y,- for 
i 6 [tn]). Let <J> be the map (from n x n positive semidefinite matrices to m x m positive semidef- 
inite diagonal matrices) defined by ^(X) = Diag(Tr A\X, . . . , Tr A m X). Then its adjoint map 

acts as <3>*(Y) = YT =1 Y(i,i) ■ A t (for all diagonal matrices Y > 0). We let 1 represent the 
identity matrix (in the appropriate dimensions clear from the context). For Hermitian matrix 
B and real number I, let A//(B) represent the sum of eigenvalues of B which are at least /. The 
algorithm is mentioned in Figured] 

3 Analysis 

For all of this section, let = In the following we assume that n is sufficiently large and e 
is sufficiently small. 



minimize: TrX 
subject to: Vi e [m] : Tr A t X > 1, 
X > 0. 
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Input : Positive semidefinite matrices A\, . . . , A m and error parameter £ > 0. 
Output : X* feasible for P and Y* feasible for D. 

1. Let e = -4-, t = 0, X = 0. Let k s be the smallest positive number such that (1 + eo)* 8 < ||<E>* (1) || < 
(l + e ) /Cs+1 .' l Letfc = fc s . 

2. LetY, = exp(-<D(X t )). 

3. If TrYf > -4w,do 

(a) If ||<E>* (Y t ) || < (1 + e ) k , then set k <- k - 1 and repeat this step. 

(b) Setthr' = k. 

(c) If 

N (1+Eo)thr ^(4>*(Y t )) > (l + ^)N {1+E0)thr ,(O*(Y t )). 

then thr' <— thr' — 1 and repeat this step. Else set thr = thr'. 

(d) Let Flf be the projector on the eigenspace of <E>*(Yf) with eigenvalues at least (1 + £o) thr - For 
A > 0, let Pr be the projection onto eigenspace of <J>(ALIf ) with eigenvalues at least 1\fi. Let Pr 
be the projection onto eigenspace of O(ALIf) with eigenvalues at most 2 v / £- Find Af such that 

1. Tr(PjYfPg)*(n t ) > v / iTrY f O(n t ) and, 

2. Tr(P|Y f P| f )0(n t ) > (1 - Ve)TrY f O(n t ) as follows. 

i. Sort {TrA,TIf}^L 1 in non-increasing order. Suppose Tr Al Tit > TrAy 2 FIf > ••• > TrAy m FIf. 

ii. Find index r £ [m] satisfying 

;• m 

E Vh Tr A h U * ^ Vi E % Tr A /)c n f/ and 

fc=l /c=l 
m m 

E % Tr ^n f > (i - y/i) £ % Tr A A n f . 

fc=f k=l 

iii. LetA f = ,57^. 

(e) Let X t+ i =X t + A f n f . Set i <- f + 1 and go to Step 2. 

4. Let tf = t,kf = k. Let a be the minimum eigenvalue of <3>(X^). Output X* = XtJcc. 

5. Let t' be such that Tr Y t i / \\<$>*(Y t r) \\ is the maximum among all time steps. Output Y* = 



Yf,/||0*(Y, 



/'J 



Figure 1: Algorithm 



3.1 Optimality 

In this section we present the analysis assuming that all the operations performed by the al- 
gorithm are perfect. We claim, without going into further details, that similar analysis can 
be performed while taking into account the accuracy loss due to the actual operations of the 
algorithm in the limited running time. 
We start with following claims. 

Claim 1. For all f < tf, Af satisfies the conditions 1. and 2. in Step (3d) in the Algorithm. 
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Proof. Easily verified. □ 
Claim 2. a > 0. 

Proof. Follows since > TrY t/ = Trexp(— <J>(X t/ )) > exp(— a) . □ 

Following lemma shows that for any time f, ||<3>* (Yf ) || is not much larger than (1 + £o) thr - 
Lemma 3. For all t < t f , ||4>*(Y f )|| < (1 + e ) thr (l + £1). 

Proof. Fix any t < tf. As Tr($*(Y t )) < nN (1+£o) i(0*(Y f )), the loop at Step 3(c) runs at most 
RT% times - Hence 

\\®*(Yt)\\ < (l + eo)^ 1 < (l + £ ) thr (l + eo) ta(1+ ^ )+1 



< (1 + £o r r (i + ^) = a + £o r r (i + d). 



□ 



Following lemma shows that as t increases, there is a reduction in the trace of the dual 
variable in terms of the trace of the primal variable. 

Lemma 4. For all t < tf we have,TrY t+l < TrY t - A f ■ (1-4-v/i) ■ \\®*(Yt) \\ ■ (Trllf) . 

Proof. Fix any t < tf. Let B = P|<E>(A t n f )Pf . Note that B < <J>(A f n f ) and also B < 
2 v / il. Second last inequality below follows from Lemma|3]which shows that all eigenvalues of 
n f <J>*(Yf)IIf are at least (1 - t x ) ||<E>*(Vf) ||. 

Tr Y t+1 = Trexp(-0(X t ) - <D(A t n t )) 

< Trexp(-0(X t ) - B) (since for A a > A 2 ,Trexp(A!) > Trexp(A 2 )) 
= Trexp(-0(X f ))exp(-B) 

< Trexp(-$(X f ))(l- (1 -2Ve)B) (since for A < 1 : exp(-SA) <t-S(l-S)A) 
= TrY f ~ (l-2V£)TrY f B 

< Tr Y f - (1 - v/£)(l - 2y/i) TrY f O(A f n f ) (from step 3(d) part 1.) 
= Tr Yf - (1 - y/z) (1 - 2>/I) Tr (Yf )A f TIf 

< Tr Y f - (1 - ei )(l - - 2Vi)A, ||<D*(Y f ) || (Trn t ) 
<TrY t - (l-4Vi)Af ||<D*(Y f )|| (TrlT t ). 



□ 



Following lemma relates the trace of Xf , with the trace of Y* and Yf 
Lemma 5. TrX f/ < • (Tr Y*) ■ ln(m/ Tr Y f/ ) . 

Proof. Using Lemma [4] we have, 
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TrY m (l-4Vi)A f l|$*(yf)ll(Trn t ) 
TrY f - TrYf 

^^M^Hj (since exp(-,)>l-,) 

/ (l-4^)A f Trn^ 
< exp I I (from property of Y ) 



exp 



(l-Vi)Tr(X t+1 -X f ) 



TrY* 



This implies, 



TrY f/ . < (TrY )exp 



(l-4^)TrX t / 



TrY* / 

(TrY*) hx{m /(TrY f )) 

TrXf < —=- r — (since TrY = m). 

1 (l-4Ve) 



□ 



We can now finally bound the trace of X* in terms of the trace of Y* . 
Theorem 6. X* and Y* are feasible for the P and D respectively and 

TrX* < (1 +5Ve)TrY* . 

Therefore, since opt(P) = opt(D), 

opt(D) =opt(P) <TrX* < (l+5\/i)TrY* < (1 + 5Ve)opt(D) = (1 + 5Ve)opt(P) . 

Proof. It is easily verified that X* and Y* are feasible for P and D respectively. From Lemma [5] 
we have, 

a TrX* = TrX f/ < - _ 1 ■ (TrY*) ■ ln(m/Tr Y tf ) . 
Since Y tf — exp(— 0(X f/ .)) we have 

TrY f/ =Trexp(-$(X f/ )) > ||exp(-*(X t/ ))|| =exp(-«) . 

Using above two equations we have, 

i ln(m/TrYf,) 
TrX* < —=■ (TrY*) 



l-4y/i y 1 ln(l/TrY t .) 



(TrY*)- 1 + 



l-Ay/i y ' \ ln(l/TrY f/ ) 

< 1 + g _ ■ (TrY*) (since TrY ff < — ' 
~ 1 - 4V£ ' y f - w> 

< (l + 5Ve) - TrY* . 



□ 
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3.2 Time complexity 

In this section we are primarily interested in bounding the number of iterations of the algo- 
rithm, that is we will bound kj and also the number of iterations for any given k. We claim, 
without going into further details, that the actions required by the algorithm in any given it- 
eration can all be performed in time polylog(n) ■ polylog(m) ■ poly(|) (since operations for 
Hermitian matrices like eigenspace decomposition, exponentiation, and other operations like 
sorting and binary search for a list of real numbers etc. can be all be performed in polylog 
time). 

Let us first introduce some notation. Let A be a Hermitian matrix and I be a real number. 

Let 

• Tlf denote the projector onto the space spanned by the eigenvectors of A with eigenval- 
ues at least /. Let Tl A be shorthand for Tlf. 

• N[(A) denote the sum of eigenvalues of A at least /. Thus N; ( A) = Tr Tlf A. Let N(A) be 
shorthand for Ni(A). 

• Ajt(A) denote the k-th largest eigenvalue of A. 

• X^(A) = (Xi(A),- ■ ■ , A„(A)). 

• for any two vectors u, v £ lZ n we say u majorizes v, denoted u >z v, iff 0_i U; = ELi 
and for any / £ [n] we have, E; =1 "/ > E; =1 *> i- 

We will need the following facts. 

Fact 7. |4j For n x n Hermitian matrices A and B, A > B implies A,(A) > A,(B) for all 1 < i < 
n. Thus N;(A) > N;(B) for any real number I. 

Fact 8. |4| Let A be an n x n Hermitian matrix and Pi, - " > Pr be a family of mutually orthogo- 
nal projections. Then A-^ A) y A^(£t PjAPj). 

Fact 9. [8] For any two projectors n and A, there exits an orthogonal decomposition of the un- 
derlying vector space into one dimensional and two dimensional subspaces that are invariant 
under both n and A. Moreover, inside each two-dimensional subspace, n and A are rank-one 
projectors. 

Lemma 10. Let kfbe the final value ofk. Then k s — kj = (9( logm J} 0g " ). 
Proof. Note that || <1>* (1) || = || M || < m, since for each i, \\ A ; || < 1. Hence 

k s = O((logm)/£ ) . 

Let Yfj-i = Diag(yi, . . .y m ). We have (since Tr A,- > 1 > ^ for each i), 

m(l + £ ) k f +1 >m\\<H>*0r tf -i)\\ >Tr<t>*{Y tnl ) 

TrY fr _i 1 F 2 



■y y m l/Ery fftl + l / £ 

Hence k f > -O(^). Therefore k s -k f = 0( 1 ^) = o C° sm ^ n ). □ 

Theorem 11. For any fixed k, the number of iterations of the algorithm is at most (9( lo | - ). Hence 
combined with Lemma\W\ the total number of iterations of the algorithm is at most 0( log ™\l°^ m )- 
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Proof. Fix k. Assume that the Algorithm has reached step 3(d) for this fixed k , 61o 9 s " times. As 



,2 , 



argued in the proof of Lemma[4] whenever Algorithm reaches step 3(d), thr > k — ■ Thus 

there exists a value s between k and k — such that thr = s at least 2 lo q g - times. 

From Lemma |4]we get that the sum of the eigenvalues above (1 + £o) S / is at most n(l + 
S\)(l + £o) s at the beginning of this phase. Whenever thr 7^ s in this phase, using Fact[7l we 
conclude that the eigenvalues of <l>*(Yf) above (1 + £o) s do not increase. Whenever thr = s 
in this phase, using Lemma [121 we conclude that the eigenvalues of <J>*(Yf) above (1 + £o) s 

reduce by a factor of (1 — e\). This can be seen by letting A in Lemma [121 to be 1 7^^^— - • 
<&*(P| f Y f P| ( ) and B to be /^y, <E>* (Y*) - A. Now condition 3(d) (1.) of the Algorithm gives 
condition (2) of Lemma [121 Condition (1) of Lemma [12] can also be seen to be satisfied (using 
Lemma|3) and condition (4) of Lemma [12l is false due to condition 3(c) of the Algorithm. This 
implies condition (3) of Lemma [T2l must also be false which gives us the desired conclusion. 

Therefore the eigenvalues of <I>*(Yf) above (1 + £o) s (in particular above (1 + £o) k ) will 
vanish before thr = s, 2 lo <f " times. Hence k must decrease before the Algorithm has reached 



step 3(d), 61 °^ " times. □ 

Following is a key lemma. It states that for two positive semidefinite matrices A, B, if A has 
good weight in the large (above 1) eigenvalues space of A + B and if the sum of large (above 1) 
eigenvalues of B is pretty much the same as for A + B, then the sum of eigenvalues of A + B, 
slightly below 1 should be a constant fraction larger than the sum above 1. 

Lemma 12. Let e' = Let A, B be two n x n positive semidefinite matrices satisfying 

\\A + B\\ < 1 + exand \\B\\ > 1, (1) 

Tr U A+B A > £ Tr Tl A+B ( A + B), and (2) 

Trn B B > (l-£^)Trn A+B (A + B). (3) 

Then 

Nj^LA + B) > (l + | e )N(A + B). (4) 

Proof. In order to prove this Lemma we will need to first show a few other Lemmas. By Fact[9[ 
FI B and Tl A+B decompose the underlying space V as follows, 

V = 



,2 , 




Above for each i E [k], Vj is either one-dimensional or two-dimensional subspace, invariant 
for both FI B and TL A+B and inside V, at least one of 1T B and Tl A+B survives. W is the subspace 
where both FI B and FI^ +B vanish. We identify the subspace Vj and the projector onto itself. For 
any matrix M, define M, to be VjMVj. We can see that both the projectors TI B and Tl A+B are 
decomposed into the direct sum of one-dimensional projectors as follows. 



k k 

jA+B _ C iqA- 

i=l (=1 



n B = 0nf and n A+B = 0nf 



Lemma 13. For any i 6 [k], Tl Bi = Tlf and FI^ +B = Tl Ai+Bi . That is, the eigenspace of Bj with 
eigenvalues at least 1, z's exactly the restriction ofTl B to Vj and similarly for Aj + Bj. 
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Proof. We prove n B < = U? and the other equality follows similarly. If dim V, = 1, i.e. Vj = 
span{|z;}}, then either n B |z;} = \v) or n B |i>) = 0. For the first case, Tlf = \v)(v\, and B,- = 
(p|B|t>)|p)(»| and (p|B|t>) > 1, which means n B; = For the second case, Tlf = 0, 

{v\B\v) < l,i.e. n B ' = 0. 
For the case dim Vj = 2, 

Bi = V j BV i = V i (Tl B BTl B + (t-Tl B )B(t-Tl B ))V i 

= v,(© n B )B(0 uf)Vi + Vi((w ® 0(v y - nf ))B(w ® 0(v) - nf )))v; 

i j i i 

= UfBUf + (Vi-Uf)B(Vi-Uf). 

Letnf = |oi)(t>i| and V- - nf = \v ) (v \, then 

Bi = (v^Blv^vt)^} + (v \B\v )\v )(v \ (5) 

is the spectral decomposition of B;. As n 5 ^} = nf \vx) = \v\) and n B |z? ) = n B |z? ) = 0, we 
have (vi\B\vi) > 1 and (v \B\v ) < 1, and hence n B > = \vi)(vi\. □ 

Lemma 14. 

k 

Trn B B = J^TrU B 'Bi, (6) 

!=1 

k 

Tr n A+B B = £ Tr n A < +B <B ; -, and (7) 
i=l 

fc 

Trn A+B (A + B) = J^Trn^^CAi + Bf) (8) 

i=i 

T/ien using Eq.$2$ and Eg.© we get, 

k k 

Tr n A ' +B 'B ; - < (1 - e) £ Tr n A < +B <(A; + B,). (9) 
/=i /=i 

^Trn B 'B, > (1 - e\) ^Trn A ' +B '(A/ + B,). (10) 

;=i /=i 

Proof. We prove © and I0 and © follow similarly. 

k k k 

Trn B B = YL Tr n f B = E Tr v ' n f ^ B = E Tr nf v;-bv; 

(=1 1=1 (=1 

It /c 

= £ Tr nf B, ■ = Tr n B; B, . 

i=l i=l 

□ 



Remarks: 

1. In any one-dimensional subspace V/ = span{|u}} in the decomposition of V as above, 
HYl A+B \v) = 0, then {v\(A + B)\v) < 1, which implies (v\B\v) < 1, that is n B |z;) = 0. 
But this contradicts the fact that at least one of n B and n A+B does not vanish in V,. Thus 
n A + B never vanishes in any of Vj. Therefore for all i 6 [k] we have Tr n A < +B <(A; + B;) — 
Trn A+B (A ( + B ( ) > 1. 
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2. From ©, for all i £ [k], Tr Tl A ' +B ' (A; + B,) < 1 + e x . Combined with ©, we have 

jfc < N(A + B) < jfc(l+ei). 

Lemma 15. Let 

I — {i £ [k] : Trn A '- +B 'B/ < (1 - £ 2 ) Tr n A ' +B '(A,- + B,)}, 

and 

J={ie [Jfc] : Tr n B; B, > (1 - e?) TrlT^+^A, + B,)}. 

99 

Un/|>- £ L 



Proof. From 10, 



(1 - £ 2 ) £>(A, + B,-) < (1- £ )^N(A, + B ( ) 
(e-e 2 )^N(A / + B 1 ) < (1 - e) £ N(A; + B;) 



e(fc- |J|) < (l + ei)|J| (from Remarks 1. and 2.) 

=> \I\ > q " fc. 

1 ' ~ 1 +£i + £ 

From (since for all z G [Jfc], AT(A; + B ; ) > N(B,-)), 



Thus 



It 

£N(A,- + B,-) + (1 -£?)£>( A' + B,) > (1 — £i) N(A[ + B; 

iej m t=i 

£i^N(A ! - + B i -) > (l-ei)£N(Ai + Bi) 

£l(l + £l)|/| > (l-£i)(fc- |/|) (from Remarks 1. and 2.) 

I/I > t^*- 



Un/ > 1 t -1 \k > —ek. 

' ' - \ 1 + £i + £ 1 + £ 2 I 100 



□ 



Remark: 

3. Note that for any i e In}, dim V; = 2. Otherwise, either n A < +B < = 1T B > or n B > = and 
neither of these can happen in I n / (from definitions of I and /). 

The following lemma states that for each i £ I n /, the second eigenvalue of A,- + B,- is close 
to 1. Its proof involves some direct calculations and due to space constraint we move it to 
Appendix [B] 
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Lemma 16. Let P and Q be 2 x 2 positive semidefinite matrices satisfying 

||Q||>1, ||P + Q|| <l+£i, A 2 (P + Q)<1, (11) 

Trn p+Q P > e 2 Trn p+Q (P + Q) and (12) 

Trn Q Q > (l-£^)Trn p+Q (P + Q) . (13) 

T/zen A 2 (P + Q) >l-i£ 3 r 

We can finally prove Lemma [121 By Fact[7l A+(A + B) y ^(Li A + B,). Let ) x = max{/ : 
Ay (A + B) > 1}, 72 = max{; : Ay^A; + B,)) > 1}, and /„ = j t + ^sk. Then 

E A ,(^ + B ) > E A , (E(A + B ( )J • 

;'<;'o j<jo \ i j 

According to the decomposition in Fact|9j Lemma [Til and the remarks below it, j\ = ]i = k 
and 

Y^\j{A + B) =TrTl A+B (A + B), and 



E A ; f E(^ + B i)j = E TrnA,+B! (^ ( + Bi). 



1<]2 

The RHS of both the equations are equal by Lemma [141 Therefore, 



E A ; (A + B)> £ A i(E(A + Bi)). 

</</o fc</</o V i / 



k<j<jo 

By Lemma [T5l and Lemma [T~6l 

E A 7 (ll( A i + B i)l > ' 

k<j<jo 
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Let x = N^^A + B) - N(A + B), then 

£ A ; -(A + B)<*+(^-£fc-xVl-£'). 



fc</<;'o 

Therefore from previous three inequalities, 



which implies 



^-£fc f 1 - 1$) <x+( ^-ek - x ) (1 - £'), 
100 V 9 1 ~ V 100 ' v ; 



- 100 I 9e' 



Note that e\ <C e', therefore from Remark 2., 



□ 
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A Transforming to special form 



Let us consider an instance of a positive semidefinite program as follows. 

Primal problem P Dual problem D 

m 

minimize: TrCX maximize: £ b,y, 

subject to: Vz G [m] : TrA,X > b if i=l 

X > m 

— " subject to: y, ■ A, < C, 

i=l 

Vz G [m] : y ; - > 0. 

Above C, A^, . . . , A m are n x n positive semidefinite matrices and b\, . . . , £> m are non-negative. 
Let us assume that conditions for strong duality are satisfied and optimum value for P, denoted 
opt(P), equals the optimum value for D, denoted opt(D). Assume w.l.o.g m > n (by repeating 
the first constrain in P if necessary). 

We show how to transform the primal problem to the special form and a similar transforma- 
tion can be applied to dual problem. First observe that if for some z, b\ = 0, the corresponding 
constraint in primal problem is trivial and can be removed. Similarly if for some z, the support 
of A, is not contained in the support of C, then y, must be and can be removed. Therefore we 
can assume w.l.o.g. that for all i, b, > and the support of A, is contained in the support of C. 
Hence w.l.o.g we can take the support of C as the whole space, in other words, C is invertible. 

For all i G [m], define A- = ^ . Consider the normalized Primal problem. 

Normalized Primal problem P' 

minimize: Tr X 1 
subject to: Vz G [m] : TrA-X' > 1, 
X' > 0. 

Claim 17. If X is a feasible solution to P, then C 1 ^ 2 XC 1 ^ 2 is a feasible solution to P' with the 
same objective value. Similarly if X' is a feasible solution to P' , then C _1 ^ 2 X'C -1 ^ 2 is a feasible 
solution to P with the same objective value. Hence opt(P) = opt(P'). 

Proof. Easily verified. □ 

The next step to transforming the problem is to limit the range of eigenvalues of A's. Let 
^ = min / ||A;.||. 

Claim 18. i < opt(P') < 3f. 

Proof. Note that ^1 is a feasible solution for P'. This implies opt(P') < j < '-j. Let X' be an 
optimal feasible solution for P'. Let j be such that || A'- \\ = ji. Then /3 Tr X' > Tr A'X' > 1, hence 
J < opt(P'). □ 

Let A'j = Y!j=\ a 'ij\ v ij){ v ij\ be the spectral decomposition of A'. Define for all i G [m] and 
j e [n], 



4 = <° if 4<^ ^ 

a'jj otherwise. 
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Define A" = a 'ij\ v ij) ( v ij\- Consider the transformed Primal problem P " . 

Transformed Primal problem P" 
minimize: TrX 

subject to: Vf £ [m] : TrA-'x" > 1, 
X > 0. 

Lemma 19. 1. Any feasible solution to P" is also a feasible solution to P' . 
2. opt(P') < opt(P") < opt(P')(l + e). 

Proof. 1. Follows immediately from the fact that A: < A':. 

2. First inequality follows from 1. Let X' be an optimal solution to P' and let t = Tr(X'). Let 
X" = X' + fSl. Then, since m > n, Tr X" < (1 + e) TrX'. Thus it suffices to show that X" 
is feasible to P ". 

Fix i £ [m]. Assume that there exists G [n] such that a-^ > ^p. Then, from Claim [181 

TrA-'x" > Tr^|o«)<o«| • — 1 = jSt > 1. 

Now assume that for all £ [n], fly- < ^. By d and definition of (S, ||Af|| = ||AJ|| > f> 
and A|' > A\ - f 1. Therefore 

TrA-'X- > TrA"X' + 

m 

> TrA'X' + fi— -Tr^X' = TrA-X' > 1. 
m m 

□ 

Note that for all i £ [m], the ratio between the largest eigenvalue and the smallest nonzero 
eigenvalue of A ( is at most ^ = 7- 

Finally we get the special form Primal problem P as follows. Let t = max, e [ m j \\A" \ \ and for 

d f A" 

all i £ [m] define A; = -p . Consider, 

Special form Primal problem P 
minimize: TrX 

subject to: Vz G [m] : Tr A t X > 1, 
X > 0. 

It is easily seen that there is a one-to-one correspondence between the feasible solutions to 
P and P and opt(P) = t ■ opt(P"). Therefore P satisfies all the properties that we want and 
cumulating all we have shown above, we get following conclusion. 

Lemma 20. Let X be a feasible solution to P such that Tr X < (1 + e)opt(P). A feasible solution X to 
P can be derived from X such that Tr X < (1 + e) 2 opt(P). 

Furthermore we claim, without giving further details, that X can be obtained from X in 
time polylog(n) ■ polylog(?«). 
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B Deferred Proofs 

Proof of Lemma (161 Let rj be the maximum real number such that P — r](l — n p+ Q) > 0. Set 
p 1 = p - tj(t - n p+ Q) and Qi = Q + r](l - n p+ <2). P lr Q x satisfy all the conditions in this 
Lemma and Pi is a rank one matrix. Furthermore, set P2 = Pi/||Qi|| and Q 2 = Qi/||Qi||- 
Again all the conditions in this Lemma are still satisfied by Pi, Q 2 since LT^ 2 = fl^ 1 = 11® and 
U p 2+Qi = n p i+Qi = n p +Q. As A 2 (P 2 + Q 2 ) < A 2 (P X + Q a ) = A 2 (P + Q), it suffices to prove 
that A 2 (P 2 + Q 2 ) > 1 — Consider P 2; Q 2 in the diagonal bases of Q 2 . 

|r|cos 2 rsinflcosfl \ _ _ / 1 
r*sin6>cos0 |r|sin 2 J'^ 2- ^ b 

where r eC and < b < 1. Set A = ||P 2 + Q 2 ||. Eq. CO} implies that 

A< — L_ <l + 2e 8 1 . (15) 

1 



Since 



Trn Q2 P 2 = Trn Qz (P 2 + Q 2 ) -Trn Q2 Q 2 < Trn P2+Q2 (P 2 + Q 2 ) -Trn Qz Q 2 
< e\ Trn p 2 +Q 2(p 2 + Q 2 ) = e^A < 2ef, 



we have, 
Observe that, 



r|cos 2 0<2e^. (16) 



1 

r* sin 6 cost 



1 + 



r I sin 6 cos 6 



is the eigenvector of P 2 + Q 2 with eigenvalue A. Hence Yl Pl+ ® 2 = \v)(v\. Note that A > 
b + \r\ sin 2 6, because A 2 (P 2 + Q 2 ) = 1 + |r| + b — A < 1. Consider 

Tr(n p 2+Q2p 2 ) = (t7|i^|r> 

II 2fl i 2 1 r 1 2 sin 2 8 cos 2 6 r| 3 sin 4 8 cos 2 8 

|r|cos tf+ A _ b _ |r|sin 2 e + (A _ H ,.| sin 2 g) 2 

-t _|_ i- 1 2 sin 2 e cos 2 e 
(A-b-|r|sin 2 S) 2 

|r| cos 2 0(A - b - |r| sin 2 0) 2 + 2|/-| 2 sin 2 0cos 2 0(A - b - \r\ sin 2 6) + |r| 3 sin 4 0cos 2 
(A - b - \r\ sin 2 0) 2 + |r| 2 sin 2 0cos 2 # 
|r|(A-fr) 2 cos 2 



< 



< 



(A - b - \r\ sin 2 0) 2 + |r| 2 sin 2 0cos 2 < 
Irl cos 2 8 



(■t r|sin 2 0\ 2 



2e\ 



|r|sin 2 0\ 2 
V 1 J=B~> 
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Combining with dl2l l, we obtain 



Hence 



,8 ^ J.M Kl sm u \2 



2t\ > £ 2 (1 



H sin 2 6 , 



A 



|r| sin 2 6> 2 ^_ 
1 X — b 100 

|r|sin 2 0> (l-l £ 3)(A-b) 
|r|sin 2 + (l-^e?)b>(l-^)A 



10 u K 10 



\r\+b>{l--e\)X>l--t\ . 



A 2 (P 2 + Q 2 ) = Tr(P 2 + Q 2 ) - A = 1 + |r| + b - X 
>2-^e 3 1 -(l + 2 e 8 1 )>l-i £ 3. 



□ 
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